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ABSTRACT : 





Conditions are given which ensure that a recently developed 
exact penalty function algorithm for nonlinear programming problems 



is well defined. 
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I . THE PROBLEM 



We consider the nonlinear programming problem with inequality 
constraints 

NLP maximize f (x) 

subject to g^(x) ^ 0 i = l,...,m (1) 

x e E n 

where f and g_^ are continuously differentiable and for simplicity 
we assume that a constraint qualification holds. In reference [1] we 
developed a penalty function algorithm which involves alternate cycles 
of 1) maximizing a penalty function and 2) approximating optimal Lag- 
range multipliers. In the interests of brevity the reader is referred 
to m for a complete description of the procedure and its convergence 
properties. For the purposes of this report it is enough to recall that 
at each maximization cycle we have fixed k > 0 e E* , A > 0 e E m 
and we want to find x e E n to maximize the penalty function 

m 

P(x,k,A) = f (x) - (l/k) 1 A {exp (kg. (x) )-l] (2) 

i=l 

In [2] Gould and Howe show that under certain weak conditions if x* 
is a local maximum for NLP(l) with optimal Lagrange multipliers A* , 
then there exists a k sufficiently large that P(x,k,A*) has a local 
maximum at x* . Thus, if A* is known and k is chosen large enough, 
the function P(x,k,A*) is an exact penalty function. The algorithm 
in [1] attempts to determine the optimal Lagrange multipliers iteratively 
while simultaneously searching for x* . Thus, it involves maximizing 
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P(x,k,A) for fixed A ^ A* , and it is important to determine conditions 
under which this maximization can be accomplished. If, for the particu- 
lar choice of A being used at some cycle, the P(x,k,A) function is 
unbounded (as a function of x ) then the algorithm is not well defined. 
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II. CONDITIONS FOR A WELL DEFINED ALGORITHM 

In this section we give two sets of conditions and prove that 
under either set of conditions the penalty function has a finite global 
maximum for any k > 0 e E 1 and any A > 0 e E m . 

Theorem 1 : If f(x) - 00 as | |x| | ** <» then the algorithm is well 
defined. 

Proof : The proof is simple and requires only that we examine the penalty 

term for the ith constraint 

— (l/k) X i [exp(kg i (x))-1] (3) 

with k > 0 , X^ > 0 . As g^(x) ->■ » (infeasible), (3) •*■-<*> ; but 

as g^(x) -*•-«> (feasible) (3) -> X_^/k . 

Thus , 

m m 

- (l/k) £ X exp [ (kg (x) )-l] £ l X /k (4) 

i-1 i=l 

So if f (x) -> - 00 for all x with | |x| | -*■ 00 , then also 

P(x,k,X) - * as | | x | | -* » . Hence, P is not unbounded for maximi- 
zation, and this is true for any k > 0 e E* and any X £ 0 e E . I — -1 

Theorem 2 : If a) f(x) is a strictly concave function 

b) g. (x) are convex functions for all i = l,...,m 5 and 
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c) NLP(l) has finite optimal solution x* with optimal 
Lagrange multipliers A* 

then for any fixed k>0eE 1 ,A>0eE m ,3 a finite x which 
maximizes P(x,k,A) . 

Proof : For fixed k > 0 , A > 0 we know that P(x,k,A) is a strictly 

concave function of x because of assumptions a) and b) . To show that 
a finite maximum exists it suffices to show that a finite maximum along 
any half line exists, that is, V x , d e E n , as 0 e E 1 00 the 
derivative 

P'( 0 )=-^r P (x+0d ,k, X) (5) 

must eventually become negative (or equal zero). 

Since x* maximizes P(x,k,A*) (see 12]) we know this is true 
for* X = X* . 

Thus, consider any x,deE n ,k>0eE 1 , A > 0 e E m . 

P’( 0 ) = P(x+6d,k,X) 

* — ~ |f(x+ 0 d) - (l/k) J X^^texpCkg^^Cx+Od))-!]! (6) 

= f'(0) - l ( ) exp [kg (6)] g , '(0) 

i=l 

where we have introduced the abbreviations f T ( 0 ) = f(x+6d) , 

g i ( 0 ) H g^x+ed) , g ± ' (e ) = g ± (x+0d) . 
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There are several cases for each of f and g_^ : 

Cases for f (concave) 

f 1 f (0 ) -+ - oo as 0 -* 

f 2 f (0 ) is non decreasing as 0 -* «> 

then f*(0) > 0 and decreasing as 0 -* 00 



(7) 



Cases for each (convex) 

gl g^(0) 00 as 0 -+ 00 

then $£r > 0 such that eventually g_^ f (0) ^ r so that 



y — [exp kg ± (0)J g i , (0) + - 00 as 0 + 00 (8) 

g2 g^(0) is non increasing as 0 -* 00 then exp kg^(0) > 0 

and non increasing as 0 00 > g^ f (0) £ 0 and non decrea- 
sing as 0 -* 00 , so ^“[exp kg^(0)] g^ f (0) ^ 0 and 

non increasing as 0 ® . (9) 



Analysis of Cases 

1. If _fl holds, then P(0) - 00 as 0 00 for any combina- 

tion of cases on the g^ . (see Theorem 1) Thus, P has 

a finite global maximum for any A > 0 . 

2. If f2 holds, 

2a) If also 3i with g in case jjl then (7) , (8) , (9) 
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show that P f (0 ) in (6) approaches - 00 as 0 + 00 . 

Thus P T (0) must eventually become negative so that 
P has a finite max along the half line. 

2b) Otherwise for all i = l,...,m constraint g_^ is in 
case g2 . 

then (6), (7) and (9) show that P ? (0) >0 as 0 + 00 
so that no maximum is attained. But this is true for 
any X including X = X* . 

Thus, P(x,k,X*) does not have a finite maximum contrary 

to assumption. Hence case 2b cannot occur if NLP 

has a finite optimal solution. □. 
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III. SUMMARY 

Two sets of conditions which guarantee that the exact penalty 
function algorithm in [lj is well defined have been presented and proved. 
It should perhaps also be emphasized that the algorithm in [1] is pri- 
marily a method for locating local solutions to NLP (1) , and that it can 
frequently do this even if P(x,k,A) is globally unbounded, (for non 
concave problems) since in the region of search P(x,k,A) will still 
have a local maximum. In such a case, however, the possibility of 
straying into the global unbounded region cannot be overlooked. 
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